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INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING 
METHOD AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 

The present invention relates to an information 
processing apparatus, an information processing method 
and a storage medium. More particularly, the invention 
relates to an information processing apparatus, an 
information processing method, and a storage medium for 
retrievably accommodating the method, the apparatus and 
the method permitting images to be picked up. 

In recent years, some personal computers have come 
to embrace multimedia and accommodate a CCD camera and 
its interface, the camera picking up images of a user or 
other objects. Images are picked up when an application 
program addressing such processing is carried out by the 
computer . 

Meanwhile, drastic improvements in the processing 
performance of personal computers have made it possible 
for their operating system to provide as a standard 
feature a multitask environment in which to run a 
plurality of application programs such as a word 
processor application, a spreadsheet application and an 
image processing application. 



At the same time, graphically- driven window systems 
have become a standard user interface. This has shifted 
the status of a principal manipulative device from the 
keyboard to the pointing device such as a mouse or a 
track ball. 

In that operating environment, a user utilizing a 
CCD camera mounted on a personal computer to get a 
picture of an object must first operate a pointing device 
to activate an image pickup application program. The user 
then needs to perform further operations to pick up the 
image . 

The problem is that it takes time to operate the 
pointing device moving the pointer position, pushing a 
button or manipulating other controls when and where 
appropriate. The time-consuming chore often causes the 
user to miss a perfect moment for a good picture. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention 
to provide an apparatus and a method for information 
processing allowing manipulation of a single button to 
operate a personal computer to pick up an image. 

Other objects, features and advantages of the 
invention will become more apparent upon a reading of the 
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following description and appended drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic view showing a typical 
structure of a personal computer; 

Fig. 2 is a top view of the personal computer; 

Fig. 3 is a side view of the personal computer ; 

Fig. 4 is a side view of the personal computer with 
its display part swung open away from its body; 

Fig. 5 is a front view of the personal computer ; 

Fig. 6 is a bottom view of the personal computer; 

Fig. 7 is a function block diagram of the personal 
computer; 

Fig. 8 is an explanatory view of a situation where 
an image of an object is picked up by the personal 
computer ; 

Fig. 9 is a schematic view of a display on an LCD 
in effect before a shutter button is pushed; 

Fig. 10 is a schematic view of a display on the LCD 
in effect when the shutter button is half -pushed; 

Fig. 11 is a flowchart of steps constituting a 
process of picking up a still image; and 

Fig. 12 is a flowchart of steps constituting a 
process of picking up a motion image. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figs. 1 through 6 show a typical structure of a 
portable personal computer 1 to which this invention is 
applied. The personal computer 1 is a mini - notebook type 
personal computer that primarily comprises a body 2 and a 
display part 3 attached swingingly to the body 2. Fig. 1 
is a perspective view of the computer with the display 
part 3 swung open away from the body 2. Fig. 2 is a plan 
view of the computer in Fig. 1. Fig. 3 is a left-hand 
side view of the computer with the display part 3 swung 
shut onto the body 2. Fig. 4 is a right-hand side view of 
the computer with the display part 3 swung open 180 
degrees relative to the body 2. Fig. 5 is a front view of 
the computer in Fig. 3. Fig. 6 is a bottom view of the 
computer in Fig. 4. 

The face of the body 2 comprises a keyboard 4 and a 
track point (registered trademark) 5. The keyboard 4 is 
used to input characters, symbols, etc., and the track 
point 5 is operated to move a mouse cursor. Also 
furnished on the body face is a speaker 8 for sound 
output along with a shutter button 10 operated to take a 
picture using the CCD video camera 23 mounted on the 
display part 3. 
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A pawl 13 is provided at the upper end of the 
display part 3. As shown in Fig. 3, with the display part 
3 swung closed onto the body 2, the pawl 13 hooks onto a 
hole 6 in the body 2. At the front of the body 2 is a 
slide lever 7 furnished in a crosswise movable fashion. 
The slide lever 7 is used to lock and unlock the pawl 13 
so that the pawl 13 is engaged with and disengaged from 
the hole 6. With the pawl 13 unlocked, the display part 3 
may be swung open away from the body 2. Adjacent to the 
pawl 13 is a microphone 24 which, as depicted in Fig. 6, 
may pick up sound from both the front and the back side 
of the body 2 . 

The front of the body 2 further comprises a 
programmable power key (PPK) 9. An air outlet 11 is 
provided on the right-hand side of the body 2, as shown 
in Fig. 4. At the lower end in front of the body 2 is an 
air inlet 14 as depicted in Fig. 5. To the right of the 
air outlet 11 is a slot 12 that accommodates a PCMCIA 
(Personal Computer Memory Card International Association) 
card (called a PC card) . 

An LCD (liquid crystal display) 21 for displaying 
images is provided on the front of the display part 3. At 
the upper end of the LCD 21 is an image pickup part 22 
mounted rotatably on the display part 3. More 
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specifically, the image pickup part 22 is rotatable to 
any position within a range of 180 degrees in the same 
direction as the LCD 21 and in the opposite direction 
thereof (i.e., toward the back). The image pickup part 22 
is furnished with the CCD video camera 23. 

At the lower end of the display part 3 on the body 
side is a group of lamps including a power lamp PL, a 
battery lamp BL, a message lamp ML and other LEDs . 
Reference numeral 40 in Fig. 3 denotes a power switch 
furnished on the left-hand side of the body 2, and 
reference numeral 25 in Fig. 5 represents an adjusting 
ring used to adjust the focus of the CCD video camera 23. 
Reference numeral 26 in Fig. 6 stands for a cover that 
conceals an opening through which to install an 
additional memory into the body 2, and reference numeral 
41 denotes a hole through which to insert a pin to unlock 
the cover 2 6 . 

Fig. 7 illustrates an internal structure of the 
personal computer 1. As shown in Fig. 7, an internal bus 
51 is connected to a CPU (central processing unit) 52, a 
PC card 53 inserted as needed, a RAM (random access 
memory) 54, and a graphic chip 81. The internal bus 51 is 
coupled to an external bus 55. The external bus 55, for 
its part, is connected to a hard disk drive (HDD) 56, an 
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I/O (input/output) controller 57, a keyboard controller 
58, a track point controller 59, a sound chip 60, an LCD 
controller 83, and a modem 50. 

The CPU 52 is a controller that controls diverse 
computer functions. The PC card 53 is installed as needed 
when an optional function is to be added. 

When the personal computer 1 is booted up, an 
electronic mail program (an application program) 54A, an 
auto pilot program (another application program) 54B and 
the OS (operating program) 54C are transferred from the 
HDD 56 to the RAM 54 and retained therein. 

The electronic mail program 54A is a program that 
exchanges communication messages with an external entity 
using a communication line such as a telephone line and 
by way of a network. A received mail acquisition function 
is specifically included in the electronic mail program 
54A. The received mail acquisition function checks a mail 
server 93 to see if a mail box 93A therein contains any 
mail addressed to this program (i.e., to the user). If 
any such mail is found in the mail box 93A, the received 
mail acquisition function carries out a suitable process 
to acquire that mail. 

The auto pilot program 54B is a program that starts 
up and carries out a plurality of predetermined processes 
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(or programs) in a predetermined sequence. 

The OS (operating system) 54C controls basic 
computer functions. A typical operating system is Windows 
95 (registered trademark) . 

The hard disk drive (HDD) 56 connected to the 
external bus 55 contains the electronic mail program 56A, 
auto pilot program 56B, and OS (operating system) 56C. 
During the booting process, the OS 56C, auto pilot 
program 56B and electronic mail program 56A are 
transferred successively from the hard disk drive 56 to 
the RAM 54 and stored in the memory. 

The I/O controller 57 has a microcontroller 61 
equipped with an I/O interface 62. The microcontroller 61 
is constituted by the I/O interface 62, a CPU 63, a RAM 
64 and a ROM 6 9 which are interconnected. The RAM 64 
includes a key input status register 65, an LED (light- 
emitting diode) control register 66, a set time register 
67, and a register 68. The set time register 67 is used 
to start the operation of a start sequence controller 76 
when a time preset by the user (i.e., starting condition) 
is reached. The register 68 holds a correspondence 
between a preset combination of operation keys (starting 
condition) on the one hand and an application program to 
be started on the other hand. When the user inputs the 
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preset combination of operation keys, the corresponding 
application program (e.g., electronic mail program) is 
started. 

When the fingertip-operated programmable power key 
(PPK) 9 is pushed, the key input status register 65 gets 
and retains an operation key flag. The LED control 
register 66 is used to control the illumination of the 
message lamp ML indicating that boot -up status of an 
application program (e.g., electronic mail program) which 
is held in the register 68. A desired time of day may be 
set to the set time register 67. 

The microcontroller 61 is connected to a backup 
battery 74. The battery 74 allows contents of the 
registers 65, 66 and 67 to be retained when power to the 
body 2 is turned off. 

The ROM 69 in the microcontroller 61 contains in 
advance a wake -up program 70, a key input monitoring 
program 71, and an LED control program 72. The ROM 6 9 is 
illustratively composed of an EEPROM (electrically 
erasable and programmable read only memory) . The EEPROM 
is also called a flash memory. The microcontroller 61 is 
connected to an RTC (real-time clock) 75 that keeps the 
current time. 

The wake -up program 7 0 in the ROM 6 9 is a program 
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that checks to see if a preset time in the set time 
register 67 is reached on the basis of time-of-day data 
from the RTC 75. When the preset time is reached, the 
wake-up program 70 starts up a predetermined process (or 
program) . The key input monitoring program 71 
continuously monitors whether the PPK 9 is pushed by the 
user. The LED control program 72 controls the lighting of 
the message lamp ML. 

Furthermore, the ROM 69 contains a BIOS (basic 
input/output system) 73. The BIOS is a software program 
that controls exchanges of data (input and output) 
between the OS or application software on the one hand 
and peripheral devices (e.g., display part, keyboard, 
hard disk drive) on the other hand. 

The keyboard controller 58 connected to the 
external bus 55 controls input from the keyboard 4. The 
track point controller 59 controls input from the track 
point 5 . 

The sound chip 60 receives input from the 
microphone 24, and supplies sound signals to a built-in 
speaker 8. 

The modem 50 permits connection to a communication 
network 92 such as the Internet and to the mail server 93 
through a public telephone line 90 and an Internet 
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service provider 91. 

Image data captured by the CCD video camera 23 are 
forwarded to a processing part 82 for processing. The 
image data processed by the processing part 82 are input 
to the graphic chip 81 connected to the internal bus 51. 
The graphic chip 81 stores the input video data into an 
internal VRAM 81A, and retrieves the data from the memory 
as needed for output to the LCD controller 83 . Given the 
image data from the graphic chip 81, the LCD controller 
83 outputs the data to the LCD 21 for display. Back 
lights 84 are provided to illuminate the LCD 21 from the 
back . 

The power switch 4 0 is operated to turn on and off 
the power supply. A half -push switch 85 is activated when 
the shutter button 10 is half-pushed. A full-push switch 
86 is turned on when the shutter button 10 is fully 
pushed. A reverse switch 87 is turned on when the image 
pickup part 22 is rotated by 180 degrees (i.e., when the 
CCD video camera 23 is rotated into a direction suitable 
for picking up an image on the opposite side of the LCD 
21) . 

Fig. 8 illustrates a situation where the personal 
computer 1 is used to pick up an image of an object. The 
user of the personal computer 1 rotates the image pickup 
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part 22 at the upper end of the display part 3 in the 
opposite direction of the LCD 21 so as to take a picture 
of the object in front of the user. 

Fig. 9 shows a display on the LCD 21 in effect 
before the shutter button 10 is pushed. A window 111 of 
the image pickup application program appears behind a 
window 112 of a spreadsheet application program and a 
window 113 of a word processor application program. 

Fig. 10 depicts a display on the LCD 21 in effect 
when the shutter button 10 is half -pushed. Half -pushing 
the shutter button 10 activates the window 111 of the 
image pickup application program without clicking on the 
window 111 using a pointer 114. The window 111 now 
appears in the foreground in front of the window 112 of 
the spreadsheet application program and the window 113 of 
the word processor application program. An image 
displayed in the window 111 of the image pickup 
application program is held still even if the personal 
computer 1 is altered in its orientation. In this state, 
fully pushing the shutter button 10 stores onto the HDD 
56 the image in the window 111 of the image pickup 
application program, the storage being made in a suitable 
format . 

Releasing the half -pushed shutter button 10 causes 
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the image pickup application program to set free the 
image from its motionless state in the window 111. 

Fig. 11 is a flowchart of steps constituting a 
process of picking up a still image. In step Sll, the CPU 
52 checks to see if the shutter button 10 is half -pushed 
on the basis of the input from the half -push switch 85. 
If the shutter button 10 is judged to be half-pushed, 
step S12 is reached. In step S12, the CPU 52 activates a 
window of a still image pickup application program, 
causing the window to appear in front of the windows of 
all other application programs. In step S13, the CPU 52 
holds still the image (captured through the CCD video 
camera 23) displayed in the window of the still image 
pickup application program. 

In step S14, the CPU 52 checks to see if the 
shutter button 10 is released on the basis of the input 
from the half -push switch 85. If the shutter button 10 is 
not judged to be released, step S15 is reached. In step 
S15, the CPU 52 checks to see if the shutter button 10 is 
fully pushed on the basis of the input from the full -push 
switch 86. If the shutter button 10 is judged to be fully 
pushed, step S16 is reached. In step S16, the image in 
the window of the still image pickup application program 
is stored onto the HDD 56 in an appropriate format. This 
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terminates the process of still image pickup. 

If the shutter button 10 is not judged to be fully 
pushed in step S15, step S14 is reached again. The 
operative state of the shutter button 10 is then 
continuously monitored for judgment. 

If the shutter button 10 is not judged to be half- 
pushed in step Sll or if the shutter button 10 is judged 
to be released in step S14, then the still image pickup 
process is terminated. 

As described above, the user is able to pick up a 
still image of the object by operating the shutter button 
10 alone. 

A process of picking up a motion image will now be 
described. Fig. 12 is a flowchart of steps constituting 
the motion image pickup process. In step S21, the CPU 52 
checks to see if the shutter button 10 is half -pushed on 
the basis of the input from the half -push switch 85. If 
the shutter button 10 is judged to be half -pushed, step 
S22 is reached. In step S22, a window of a motion image 
pickup application program is activated and made to 
appear in front of the windows of all other application 
programs . 

In step S23, the CPU 52 checks to see if the 
shutter button 10 is released on the basis of the input 
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from the half -push switch 85. If the shutter button 10 is 
not judged to be released, step S24 is reached. In step 

524, the CPU 52 checks to see if the shutter button 10 is 
fully pushed on the basis of the input from the full -push 
switch 86. If the shutter button 10 is judged to be fully- 
pushed, step S25 is reached. In step S25, the CPU 52 
checks to see if a motion image is being picked up. If it 
is judged that no motion image is being picked up in step 

525, step S26 is reached. In step S26, a motion image 
starts to be picked up, and the process is terminated. If 
a motion image pickup is judged to be in progress in step 
S25, step S27 is reached in which the motion image pickup 
is stopped and the process is terminated. 

If the shutter button 10 is not judged to be fully 
pushed in step S24, step S23 is reached again. The 
operative state of the shutter button 10 is then 
continuously monitored for judgment. 

If the shutter button 10 is not judged to be half- 
pushed in step S21 or if the shutter button 10 is judged 
to be released in step S23, then the motion image pickup 
process is terminated. 

As described, the user is able to carry out or stop 
the motion image pickup by operating the shutter button 
10 alone. 
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Because the shutter button 10 alone needs to be 
operated for picking up still and motion images, the user 
will not likely miss a perfect moment for a good picture. 

In the description above, the still image pickup 
application program or the motion image pickup 
application program was assumed to be already running. 
Alternatively, any one of these programs may be booted 
and executed the moment the shutter button 10 is half- 
pushed . 

Computer programs designed to perform the above - 
described processes may be retained on such storage media 
as magnetic disks, CD-ROMs, or solid state memories when 
offered to users. The programs may also be distributed by 
use of such communication media as networks and 
satellites . 

Through the use of the inventive information 
processing apparatus, information processing method and 
storage medium, the image pickup application program is 
activated when an image of an object is picked up and the 
user's suitable operations are detected. Only the shutter 
button needs to be operated for picking up still and 
motion images. 

As many apparently different embodiments of this 
invention may be made without departing from the spirit 
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and scope thereof, it is to be understood that the 
invention is not limited to the specific embodiments 
thereof except as defined in the appended claims. 
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WHAT IS CLAIMED IS: 

1. An information processing apparatus which has a 
graphic user interface adopting windows and which is 
capable of selecting and operating any of a plurality of 
application programs, said information processing 
apparatus comprising: 

image pickup means for picking up an image of an 

obj ect; 

detecting means for detecting operations performed 
by a user; and 

controlling means for controlling an application 
program so that said application program is activated to 
pick up said image when said detecting means detects 
operations . 

2. An information processing apparatus according 
to claim 1, wherein said detecting means detects a first 
and a second operation performed by said user; and 

wherein said controlling means activates a window 
for said application program for picking up said image if 
said detecting means detects said first operation, said 
controlling means further causing said image pickup means 
to pick up said image when said detecting means detects 
said second operation. 

3 . An information processing apparatus according 
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to claim 2, wherein said first operation is a half-push 
button operation and said second operation is a full -push 
button operation. 

4. An information processing method for use with a 
graphic user interface adopting windows and capable of 
selecting and operating any of a plurality of application 
programs, said information processing method comprising 
the steps of: 

picking up an image of an object; 
detecting operations performed by a user; and 
controlling an application program so that said 
application program is activated to pick up said image 
when operations are detected in said detecting step. 

5. An information processing method according to 
claim 4, wherein said detecting step detects a first and 
a second operation performed by said user; and 

wherein said controlling step activates a window 
for said application program for picking up said image if 
said detecting step detects said first operation, said 
controlling step further causing said image pickup step 
to pick up said image when said detecting step detects 
said second operation. 

6. An information processing method according to 
claim 5, wherein said first operation is a half-push 
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button operation and said second operation is a full -push 
button operation. 

7. A storage medium for storing a program in a 
manner readable by an information processing apparatus 
which has a graphic user interface adopting windows and 
which is capable of selecting and operating any of a 
plurality of application programs, said program allowing 
said information processing apparatus to execute an 
information processing method comprising the steps of: 

picking up an image of an object; 
detecting operations performed by a user; and 
controlling an application program so that said 
application program is activated to pick up said image 
when operations are detected in said detecting step. 

8. A storage medium according to claim 7, wherein 
said detecting step detects a first and a second 
operation performed by said user; and 

wherein said controlling step activates a window 
for said application program for picking up said image if 
said detecting step detects said first operation, said 
controlling step further causing said image pickup step 
to pick up said image when said detecting step detects 
said second operation. 

9. A storage medium according to claim 8, wherein 
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said first operation is a half-push button operation and 
said second operation is a full-push button operation. 
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ABSTRACT OF THE DISCLOSURE 



The invention relates to an apparatus and a method 
for information processing allowing a personal computer 
to pick up an image through operation of a single button. 
When a half -push switch is turned on, a CPU activates a 
window of an image pickup application program, causing 
the window to appear in front of the windows of all other 
application programs. An image displayed in the window of 
the image pickup application program is held still even 
if a personal computer is altered in its orientation. 
When a full -push switch is turned on, the image in the 
window of the image pickup application program is stored 
onto an HDD in a suitable format. 
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below and, insofar as the subject matter of each of the claims of this application is not disclosed in the prior United 
States application in the manner provided by the first paragraph of Title 35, United States Code § 112, I acknowledge the 
duty to disclose to the United States Patent and Trademark Office all information known to me to be material to 
patentability as defined in Title 37, Code of Federal Regulations, Sec. 1.56, which became available between the filing 
date of the prior application and the national or PCT international filing date of this application: 

Prior U.S. Application(s) [list additional applications on separate page]: 

Appln. Ser. Number: Filed (Day/Month/Year) : Status (patented, pending, abandoned): 

I hereby appoint WILLIAM S. FROMMER . Registration Mo. 25.506 . and DENNIS M. SMID . Registration No. 34.930 
or their duly appointed associate, my attorneys, with full power of substitution and revocation, to prosecute this 
application, to make alterations and amendments therein, to file continuation and divisional applications thereof, to 
receive the Patent, and to transact all business in the Patent and Trademark Office and in the Courts in connection 
therewith, and specify that all communications about the application are to be directed to the following correspondence 
address : 



WILLIAM S. FROMMER 



, Esq. 



c/o FROMMER LAURENCE & HAUG LLP 
745 Fifth Avenue 
New York, New York 10151 
I hereby declare that all statemen 
information and belief are believed to be 1 
willful false statements and the like so mi 
Title 18 of the United States Code and thai 
or any patent issued thereon. 
INVENTOR(S) : 

Signature: 
Full name 
Residence; 
Citizenship: 



Signature: 

Full name of 2nd joini 

Residence: 

Citizenship: 



D i rec 

(212) 588-0800 
to the attentio 
WILLIAM S. 



;lephone c 



FROMMER 



s made herein of my own knowledge are true and that all statements made on 
rue; and further that these statements were made with the knowledge that 
ie are punishable by fine or imprisonment, or both, under Section 1001 of 
such willful false statements may jeopardize the validity of the applicatic 



of s 



Kiyonobu K0JIMA 
Kanagawa, Japan 
Japan 



inventor (if any): 



Naoki FUJISAWA 
Kanagawa, Japan 



Post Office Address(es) of inventor(s): 

[if all inventors have the same post office address] 



Sony Corporation 
7-35 Kitashinagawa 6-chome 
Shinagawa-Ku, Tokyo 141, Japan 

Note: In order to qualify for reduced fees available to Small Entities, each inventor and any other individual or entity 
having rights to the invention must also sign an appropriate separate "Verified Statement (Declaration) Claiming [or 
Supporting a Claim by Another for] Small Entity Status" form [e.g. for Independent Inventor, Small Business Concern, 
Nonprofit Organization, individual Non- Inventor] . 

Note: A post office address must be provided for each inventor. 
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